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Abstract 


This  -inv^stigatiort  involved  the  conparison  of  three  types  of 
channel  estimation  techniques,  the  Feedforward  Estimator,  the 
Feedback  Estimator,  and  the  Lattice  Estimator.  A  conputer 
simulation  of  a  conmuni cations  channel  was  run  involving  varying 
levels  of  amplitude  distortion,  phase  distortion,  and  Gaussian 

noise  imposed  on  a  data  stream.  The  resulting  output  of  the 
channel  was  fed  to  a  receiver  consisting  of  a  detector  and  a 
channel  estimator.  The  estimator  took  the  output  of  the  channel 
and  the  detector  and  used  them  to  identify  the  inpulse  response 
of  the  channel. 

Of  the  three  channel  estimators,  the  Feedback  Estimator 
proved  superior  in  terms  of  performance  under  varying  levels  of 
channel  distortion  and  noise.  Furthermore,  the  Feedback 
Estimator  demonstrated  the  best  error  handling  capabilities. 
Finally,  the  Feedback  Estimator  proved  to  be  the  simplest 
algorithm  to  implement  of  the  three.  •.  •  y 


1 .  Introduction 


When  signals  are  sent  across  contnuni cat ions  channels  such 
as  telephone  lines,  the  result  is  often  a  distorted  version  of 
the  original  transmitted  message.  To  recover  the  original 
message,  the  receiver  must  combat  the  anplitude  and  phase 
distortion  and  the  noise  the  signal  has  picked  up  from  the 
channel.  Complicating  the  problem  is  that  the  distortion  may  be 
time-varying . 

Various  methods  of  combatting  the  time-varying  distortion 
and  noise  have  been  attempted  but  the  most  promising  results  have 
come  from  using  adaptive  techniques.  These  adaptive  techniques 
continuously  adjust  the  receiver  to  the  changing  conditions  of 
the  channel. 

Two  of  the  most  widely  used  adaptive  techniques  are  channel 
equalizers  and  channel  estimators  (1:2; 3).  Both  channel 
equalizers  and  estimators  form  an  estimate  of  the  inpulse 
response  of  the  comnuni cation  channel  to  use  in  adjusting  the 
receiver  for  proper  signal  reception.  The  techniques  differ  in 
that  while  the  channel  equalizer  uses  the  estimated  impulse 
response  directly  to  compensate  for  the  noise  and  distortion,  the 
channel  estimator  forms  the  estimated  channel  inpulse  response 
and  then  passes  it  onto  a  detector  (see  Figure  1).  The  detector 


uses  the  estimate  with  a  probabilistic  detection  algorithm,  such 
as  the  Viterbi  algorithm  (4),  to  compensate  for  the  channel 


effects.  Various  types  of  estimators  have  been  proposed  but 
little  data  is  available  to  make  comparisons  among  them  (1;2;3). 


Receiver 


Figure  1.  Communication  System  Utilizing  a  Channel  Estimator 
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Problem 


The  problem  to  be  investigated  is  the  evaluation  of  the 
performance  of  various  channel  estimators,  and  the  design  and 
evaluation  of  an  estimator  based  on  lattice  techniques.  The 
latter  is  a  method  of  using  an  adaptive  lattice  filter  to 
estimate  the  inpulse  response  (or  transfer  function)  of  a  system. 
The  goal  of  this  study  is  to  determine  the  best  overall 
estimation  method  and  to  determine  any  special  instances  where 
one  technique  may  be  preferrable  over  smother. 

Scope 


The  following  types  of  channel  estimators  were  analyzed  and 
tested: 

1 .  Feedforward  Estimator 

2 .  Feedback  Estimator 

3.  Lattice  Estimator 

These  channel  estimators  represent  feedforward,  feedback,  and 
hybrid  types  of  estimators  (1;2?3;4;5).  Each  estimator  was 
evaluated  by  inputting  a  signal  containing  various  combinations 
of  amplitude  and  phase  distortion,  and  noise  caused  by  the 


channel . 


To  make  the  proposed  problem  manageable,  the  following 
assumptions  must  be  made: 

1.  All  data  symbols  emitted  by  the  source  will  be 
statistically  independent  and  have  equal  probability  of 
being  either  1  or  -1.  This  assunption  is  based  on  the 
premise  that  in  any  random  data  stream  either  symbol  may 
occur  at  any  time  and  that  the  result  of  one  symbol 
being  received  does  not  bias  what  the  next  symbol  will 
be. 

2.  Each  symbol  will  be  spaced  at  an  interval  of  time  T, 
apart.  This  assumption  allows  for  the  measure  of  any 
phase  errors  that  occur  as  a  result  of  the  channel. 

3.  No  special  encoding  of  the  signal  is  assumed  for  this 
source. 

4.  The  channel  operates  in  an  additive  white  Gaussian  noise 
environment.  Burst  error  noise  will  also  be  considered. 

5.  The  comnunication  system  operates  with  a  low  probability 


of  error. 
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System  Model 

The  conmunications  system  of  Figure  1  can  be  more  usefully 
modeled  as  shown  in  Figure  2  (1).  In  this  model,  sampled  input 
symbols  are  fed  into  the  baseband  channel.  The  baseband 
channel  then  induces  amplitude  (Gl)  and  phase  distortion  (B1  and 
B2)  and  adds  a  noise  term  according  to  the  equation 

Y(f)  =  X(f)  C  (1  +  Gif)  exp(-j2rrf  +  Bl-f2  +  B2-f3)  (2.1) 

in  the  frequency  domain  which  in  the  time  domain  appears  as 

y(t)  =  x(t-T)  +  (Gl/2  rr )  x'(t-T)  +(B1/4tT2)  x”(t-T) 

+  (B2/8tt3)  x '  1  1  ( t— T)  (2.2) 

Where  x(t-T)  is  a  delayed  time  version  of  the  input  symbol  x^ 
( 6  ?  1 1 ) . 

The  baseband  channel  can  be  modeled  as  a  conposite  of  three 
filters  and  a  white  gaussian  noise  source.  Two  of  the  filters 
represent  the  input  and  output  characteristics  of  the  transmitter 
and  receiver  respectively.  A  third  filter  represents  the 
characteristics  of  the  transmission  path.  An  equivalent 
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igure  2.  Idealized  Model  of  a  Syncnronous  Serial  binary  Systeri 


discrete-time  filter  is  shown  in  Figure  4  (5)  where  the  sanpled 
output  of  the  channel  is  found  by 


■  £  ■>  v, 


(2.3) 


where 


-  the  total  nuntoer  of  stages  of  the  filter 
=  unknown  tap  gain  coefficients  of  the  channel 

and  also  the  sampled  inpulse  response  of  the  system 
=  input  symbol  to  baseband  channel 
=  sanpled  gaussian  noise  conponent  of  the  channel 


The  overall  sanpled  inpulse  response  of  the  system  to  the 
symbols  can  be  written  as  the  (G) -conponent  row  vectors 


H  =  [  hx  h2  ...  hQ  ] 


(2.4) 


The  discrete  output  y^  is  received  by  both  the  detector  and 
the  channel  estimator.  The  detector  determines  the  symbols  X^' , 
which  corresponds  to  the  transmitted  symbols  X^,  by  using  the 
sanpled  output  y^  and  an  estimate  of  the  channel  H’^  from  the 
estimator.  H'^  is  defined  as  the  (G)-conponent  row  vector 
containing  an  estimate  of  the  channel  such  that 


H  K  ^  ^  k,l  ^  k,2  ***  ^  k,G^ 


(2.5) 


! 

i 

( 


where  h*  .  represents  the  j'th  tap  gain  for  the  k'th  sample. 

The  estimator  takes  the  y^  output  and  uses  it  and  the  X'^ 
symbol  to  update  the  H1^  row  vector  to  prepare  for  the  yk+1 
output  of  the  channel. 


Feedforward  Estimator 


The  Feedforward  Estimator  is  an  application  of  an  adaptive 
linear  transversal  filter  in  which  the  tap  gains,  H'^,  are 
updated  automatically  to  minimize  the  mean  squared  error  between 


the  input  to  the  detector  and  an  estimate  or  predicted  value 
of  the  input  to  the  estimator  y'^.  The  method  employed  to 
minimize  the  error  between  }  and  y'^  is  a  gradient  search 
algorithm  known  as  the  Least-Mean-Squared  (LMS)  algorithm 
(3;7;8).  In  the  LMS  algorithm,  future  values  of  the  tap  gains, 


are  found  using  the  past  values,  H'^,  and  the  current  and 


some  prior  outputs  of  the  detector,  X1^.  The  LMS  algorithm  can 


be  expressed  as: 


=  the  updated  G-component  row  vector  containing  the 
estimated  inpulse  response  of  the  system. 

H'^  =  the  prior  G-component  row  vector  containing  the 

estimated  impulse  response  of  the  system. 


A=  the  convergence  factor  which  is  a  constant  that 
determines  how  quickly  the  estimator  responds  to 
changes  in  the  channel. 


E'^  =  the  difference  between  the  input  of  the  channel, 

y^,  and  the  predicted  value,  y'  ,  generated  by  the 
estimator. 

=  ^  el  *  e2 '  *  *  *  *  ®k  ^ 


the  updated  G-component  row  vector  containing  the 
outputs  from  the  detector 

[x‘k-j'  xk- j+1 '  *•*  '  x‘k-j+G] 


The  operation  of  the  Feedforward  Estimator  is  illustrated  in 
Figure  5.  The  current  output  of  the  detector,  X1^,  is  fed  into 
the  estimator  and,  with  the  (G-l)  prior  outputs  of  the  detector, 
is  multiplied  by  the  G-components  of  H'^  and  the  result  is  suimed 
to  form  an  estimate  of  the  channel  output  y'  .  Subtracting  y* 
from  y^  forms  the  error  signal  which  is  then  weighted  by  the 

convergence  factor  A  .  This  weighting  by  ZS  controls  how 
quickly  the  tap  gains  of  are  changing  in  response  to  a 

single  input.  The  weighted  error  signal  is  then  multiplied  by 
the  present  and  G  prior  inputs  and  the  result  added  to  the 
current  tap  gains  of  H'  to  form  H’ 


This  result  is  then  fed 


«*.V 


1  DQAY 

Figure  5.  Feedforward  Estimator 
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to  the  detector  for  use  when  the  y'^  output  of  the  channel 

p 

occurs.  The  cycle  then  begins  again.  A  total  of  G 
multiplications  are  required  for  this  technique. 
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Feedback  Estimator 


Unlike  the  Feedforward  Estimator  which  uses  X'.  .  and  H\  to 

k-j  k 

update  the  H’^  tap  gain  values,  the  Feedback  Estimator  uses  X'k 
and  to  derive  the  tap  gain  estimates  of  H'^.  The  recursive 
algorithm  used  to  do  so  can  be  expressed  graphically  as  shown  in 
Figure  6  (1). 

Initially  the  first  (G+l)  outputs  from  the  channel  are 
shifted  into  the  estimator.  The  y^  input  from  the  channel  is 
divided  by  the  output  of  the  estimator  x'^  to  form: 


k,  j 


,j  ■  ** '  x'i 


(2.7) 


where  v^_.  is  the  rough  estimate  of  h’k  Using  this  rough 

estimate  v  the  convergence  factor  A,  and  the  prior  value  of 
J 

the  tap  gain  h.  ,  .  ,  we  can  obtain  the  updated  value  of  h.  .by: 

t j  K , j 


h’k,j =  Avk,j +  (1_A)  h'k-i,j 


(2.8) 


This  result  is  then  fed  to  the  multipliers  and  multiplied  by 
X'k+1  where  X'^+1  can  be  written  as: 


X'k+1  *-x'k+l,  x  k+2 ,  **■  '  x 


k+G+1 


]  (2.9) 


15 


c 


The  results  from  the  multipliers  are  then  fed  to  the  adders 
and  the  results  shifted  according  to: 

-  <XW  h'k,j  ,2-10> 

No  new  data  points  are  fed  into  the  estimator  at  this  point. 
Equations  (2.8)  and  (2.10)  are  repeated  until  all  (G+l)  original 
values  have  been  shifted  through,  at  which  point  H'^  will  have 
been  updated.  This  value  of  H'^  corresponds  to  what  the 
estimator  believes  the  channel's  tap  gains  were  at  the  time  that 
the  symbol  x'^  was  transmitted. 

The  algorithm  is  repeated  with  the  (G+l)  values  that  follow 
the  previous  and  the  algorithm,  expressed  in  equations  (2.7), 
(2.8),  and  (2.10),  begins  again  until  the  source  stops  sending 
symbols  through  the  channel.  Each  time  the  algorithm  goes 
through  a  conplete  cycle  (l/2) (G+l ) (G+2 )  multiplications  are 
required  (1). 


Lattice  Estimator 


The  adaptive  lattice  estimator  (Figure  7)  utilizes  a  lattice 
filter  stage  to  orthogonalize  the  output  signal  from  the  detector 
before  entering  a  transversal  filter  stage.  The  advantages  of 
orthogonalizing  the  signal  is  in  the  possible  increased  speed  of 
adaption  and  performance  approaching  that  of  much  more 
computationally  intensive  exact  least  squared  algorithms  (8). 

The  general  form  of  a  lattice  filter  has  been  derived  in 
Appendix  B.  The  lattice  of  Figure  7  functions  according  to  the 
following  algorithm: 


X’x 

=  *k.j  = 

X  ' 

*  k,j 

j=  0 ,G—1 

(2. 

.11) 

*X, j+1 

=  *X,j  + 

Vl.j  *' 

X-1,  j 

(2. 

.12) 

X,j+1 

=  ^-l,  j 

\.j  +  x’ 

X-l ,  j 

(2. 

.13) 

efk 

=  *X,G 

(2. 

.14) 

x'k,G 

(2. 

.15) 

*X#  j 

=  kk-l , j 

-  A1 

r  j+1  X  X-1  , j 

(2. 

.16) 

where 


x'^  =  k'th  output  from  the  detector 


=  k ’ th  input  at  the  upper  j ' th  stage  of  the 


lattice 


4 


m 

■m 


x '  .  =  k '  th  output  at  the  lower  j ' th  stage  of 

K  *  D 

the  lattice 


k,  =  adaptive  lattice  tap  gains 


e^  =  the  output  of  the  upper  portion  of  the 
lattice  from  the  (G-l)'th  stage 


=  the  output  of  the  lower  portion  of  the 
lattice  from  the  (G-l)’th  stage 


=  convergence  factor  for  the  adaptive 
lattice 


G  =  number  of  stages  in  the  lattice  filter 
plus  one 


Eq  (2.16)  is  a  Least-Mean-Squared  (LMS)  algorithm  used  to  update 
the  lattice  tap  gains,  k  (8). 

The  adaptive  transversal  filter  portion  of  the  filter 
operates  according  to  the  algorithm: 


=  h  X  k-1' 3 


(2.17) 
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where 


y'k  =  the  predicted  value  of  the  input  to 
the  estimator 

=  the  actual  value  of  the  input  to  the 
estimator 

h',  .  =  the  j'th  estimated  tap  gain  for  the 

*  *  J 

k'th  input  to  the  transversal  filter 

x '  .  =  the  k ' th  input  at  the  lower  j ' th 

K  *  j 

stage  of  the  lattice 

=  the  difference  between  the  actual 
value  and  the  estimated  value  of  the 
input  to  the  estimator 

A  2  =  the  convergence  factor  for  the 

adaptive  transversal  filter 

Eq  (2.19)  is  also  a  Least-Mean-Srjuared  (LMS)  algorithm  and  is 
used  to  update  the  tap  gain  values,  h  of  the  transversal  filter. 


c 


This  is  a  slightly  different  form  from  the  LMS  algorithm  used  in 
the  feedforward  estimator  (Eq  (2.6)). 


These  two  algorithms  work  in  conjunction  as  shown  in 

Figure  7  to  form  the  impulse  response  of  t  e  system,  H’^  of 

Eq  (2.5).  This  estimated  inpulse  response  is  then  sent  to  the 

2  2 

detector  as  with  the  other  estimators.  A  total  of  G  (G-l) 
multiplications  are  required. 
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3.  Results 


To  evaluate  the  three  classes  of  estimators,  plots  were  made 
to  illustrate  their  various  characteristic  (See  Appendix  E  for 
selected  plots).  The  characteristics  evaluated  were: 

1.  The  range  of  convergence  factors  (  A  or  A^  and  A2) 

2.  The  rate  of  convergence  for  selected  convergence  factors 
with  varying  levels  and  combinations  of  amplitude  (Gl) 
and  phase  (B1  and  B2)  distortion  and  noise 

3.  The  response  and  recovery  of  the  estimators  due  to 
errors  in  the  data  stream 

4.  Response  to  change  in  channel  characteristics 

The  resulting  data  from  the  tests  on  the  estimators  were 
plotted  as  the  RMS  value  of  the  selected  estimator  parameter 
(such  as  weightl )  versus  the  number  of  sample  or  iteration  (See 
Figure  8).  To  allow  comparisons  among  the  different  estimators 
only  the  values  of  the  weights,  H^',  were  used  from  the  various 
plots  available.  Data  taken  from  their  plots  are  summarized  in 


Tables  I  -  X. 


Rate  of  Convergence  for  Selected  A1  s 

For  conparison  purposes,  convergence  factors  of  .1,  .01  and 
.001  were  selected  for  the  Feedforward  and  the  Feedback 
Estimators  and  for  the  Lattice  Estimator  Al  =  .01,  A2=.l  and, 
Al  =  .01,  A 2=.01  and  Al  =  .001  and  A2=.301. 

With  no-noise  and  no-distortion  on  the  chanel,  the  weights 
of  the  estimators  converge  to  a  constant  value.  Refering  to 
Tables  I  -  IX,  all  estimators  tended  to  converge  at  approximately 
the  same  rate  when  A=.331  (Al=.331  and  A2=.031  in  the  Lattice 
case)  regardles  of  the  number  of  weights.  In  the  case  of  A  =.31 
(  A  1  =  .31 ,  A2=  .31),  the  Feedback  Estimator  converged  in  only  75 

samples  while  the  Lattice  Estimator  required  433  sanples  and  the 
Feedforward  estimator  required  633  samples.  When  A=.l  all 
estimators  converged  approximately  in  the  same  range  of  73-103 
sanples  depending  upon  the  number  of  weights  involved. 

The  addition  of  anplitude  distortion  (Gl),  quadratic  phase 
distortion  (Bl),  cubic  phase  distortion  (B2)  and/or  Gaussian 
noise  tended  to  effect  all  three  types  of  estimators  much  the 
same.  All  estimators  tended  to  deviate  (or  oscillate)  around  the 
optimum,  no-noise,  no-distortion  value  of  ^ '  with  the  percentage 
of  deviation  defined  as  the  maximum  value  minus  the  minimum  value 
of  H,  1  under  the  current  channel  conditions  divided  by  the  value 

Jv 

of  H^,' under  the  no-noise,  no-distortion  condition  after  the 
weights  have  converged.  The  greatest  deviations  were  encountered 
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Figure  8.  Typical  Plot  of  Estimator  Output 


TABLE  I 

Feedforward 

For 

Estimator  Characteristics 
Three  Weight  Case 

ESTIMATOR  ,  NUMBER  CONVERGENCE  CHANNEL 

TYPE  [  OF  FACTOR  CHARACTERISTICS 

I  STAGES  a  B1  B2  G1  NOISE 

(RMS) 


forward 


CONVERGENCE  DEVIATION 
(NUMBER  OF  (PERCENT) 
SAMPLES) 


0 

0 

0 

1 

0 

0 

0 

1 

0 

0 

0 

1 

0 

0 

0 

1 

1 

1 

0 

0 

0 

1 

0 

0 

0 

1 

0 

0 

0 

1 

0 

0 

0 

1 

1 

1 

0 

0 

0 

1 

0 

0 

0 

1 

0 

0 

0 

1 

0 

0 

0 

1 

1 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

35 

25 
22 

26 
78 

Unstable 
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TABLE  II 

Feedforward  Estimator  Characteristics 
for  Seven  Weight  Case 


o 


NUMBER 

CONVERGENCE 

CHANNEL 

CONVERGENCE 

OF 

FACTOR 

CHARACTERISTICS 

(NUMBER  OF 

STAGES 

A 

Bl  B2  G1  NOISE 

SAMPLES) 

(RMS) 

forward 


0 

0 

0 

1 

0 

0 

0 

1 

0 

0 

0 

1 

0 

0 

0 

1 

1 

1 

0 

0 

0 

1 

0 

0 

0 

1 

0 

0 

0 

1 

0 

0 

0 

1 

1 

1 

0 

0 

0 

1 

0 

0 

0 

1 

0 

0 

0 

1 

0 

0 

0 

1 

1 

1 

0 

0 

0 

0 

0 

0 

5000 

5000 

5000 

5000 

5000 

5000 

100 

Unstable 


None 

5 
2 
2 

6 
10 

None 

5 

<1 

2 

4 

10 

None 

<1 

<1 

<1 

<1 

<1 

None 


TOR  NUMBER  CONVERGENCE  CHANNEL  CONVERGENCE  DEVIATON 

TYPE  OF  FACTOR  CHARACTERISTICS  (NUMBER  OF  (PERCENT) 

STAGES  A  Bl  B2  G1  NOISE  SAMPLES) 

^  (RMS) 
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TABLE  IV 


Feeback  Estimator  Characteristics 
for  Three  Weight  Case 


ESTIMATOR 

TYPE 

NUMBER 

OF 

STAGES 

CONVERGENCE 

FACTOR 

A 

CHANNEL 

CHARACTERISTICS 
B1  B2  G1  NOISE 
(RMS) 

CONVERGENCE 
(NUMBER  OF 
SAMPLES) 

DEVIATON 

(PERCENT) 

Feedback 

3 

.1 

0 

0 

0 

0 

70 

None 

1 

0 

0 

0 

70 

3 

0 

1 

0 

0 

70 

2 

0 

0 

1 

0 

70 

<1 

0 

0 

0 

.2 

70 

4 

1 

1 

1 

.2 

70 

8 

.01 

0 

0 

0 

0 

70 

None 

1 

0 

0 

0 

70 

5 

0 

1 

0 

0 

70 

<1 

0 

0 

1 

0 

70 

2 

0 

0 

0 

.2 

70 

4 

1 

1 

1 

.2 

75 

10 

.001 

0 

0 

0 

0 

5000 

None 

1 

0 

0 

0 

5000 

<1 

0 

1 

0 

0 

5000 

<1 

0 

0 

1 

0 

5000 

<1 

0 

0 

0 

.2 

5000 

<1 

1 

1 

1 

1 

.2 

5000 

<1 

.2 

0 

0 

0 

0 

40 

None 

.3 

0 

0 

0 

0 

30 

None 

.4 

0 

0 

0 

0 

18 

None 

.5 

0 

0 

0 

0 

12 

None 

.5 

0 

0 

0 

0 

12 

None 

.6 

0 

0 

0 

0 

8 

None 

.7 

0 

0 

0 

0 

6 

None 

.9 

0 

0 

0 

0 

3 

None 

1.0 

0 

0 

0 

0 

1 

None 
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TABLE  V 

Feedback  Estimator  Characteristics 
for  Seven  Weight  Case 

ESTIMATOR  NUMBER  CONVERGENCE  CHANNEL  CONVERGENCE  DEVIATON 

TYPE  OF  FACTOR  CHARACTERISTICS  (NUMBER  OF  (PERCENT) 

STAGES  »  B1  B2  G1  NOISE  SAMPLES) 

^  (RMS) 


Feedback 


$ 


000 
10  0 
0  10 
0  0  1 
0  0  0 
111 

0  0  0 
10  0 
0  10 
0  0  1 
0  0  0 
111 

0  0  0 
10  0 
0  10 
0  0  1 
0  0  0 
111 

0  0  0 
0  0  0 
0  0  0 
0  0  0 
0  0  0 
0  0  0 
0  0  0 
0  0  0 
0  0  0 


5000 

5000 

5000 

5000 

5000 

5000 


None 

8 

1 

<1 

2 

10 

None 

4 

<1 

2 

4 

6 

None 

<1 

<1 

<1 

<1 

<1 

None 

None 

None 

None 

None 

None 

None 

None 

None 


1 M 

ST 

NUMBER 

CONVERGENCE 

CHANNEL 

CONVERGENCE 

OF 

FACTOR 

CHARACTERISTICS 

(NUMBER  OF 

STAGES 

A 

B1  B2  G1  NOISE 
(RMS) 

SAMPLES) 

TABLE  VIII 

Lattice  Estimator  Characteristics 
for  Seven  Weight  Case 


ESTIMATOR  NUMBER  CONVERGENCE  CHANNEL  CONVERGENCE 

TYPE  OF  FACTOR  CHARACTERISTICS  (NUMBER  OF 

STAGES  *  a  Bl  B2  G1  NOISE  SAMPLES) 

Al  A2  (RMS) 


Lattice 


.01  .0: 


001  .001 


0 

0 

0 

1 

0 

0 

0 

1 

0 

0 

0 

1 

0 

0 

0 

1 

1 

1 

0 

0 

0 

1 

0 

0 

0 

1 

0 

0 

0 

1 

0 

0 

0 

1 

1 

1 

0 

0 

0 

1 

0 

0 

0 
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0 

0 

0 

1 

0 

0 

0 

TABLE  IX 


whenever  quadratic  distortion  (Bl)  or  Gaussian  noise  was  added. 
The  effects  of  cubic  phase  distortion  (B2)  and  amplitude 
distortion  (Gl)  caused  less  than  half  as  much  deviation  in 
general . 

All  three  estimators  tended  to  react  similarly  to  the 
distortions  and/or  noise  to  the  channel  regardless  of  the  number 
of  weights  for  the  selected  convergence  factors  with  the 
exception  of  the  Lattice  Estimator  with  Al  =  .01  and  A2=.l.  In 
this  case,  the  Lattice  Estimator  demonstrated  increased 
distortion  depending  on  the  number  of  weights  whenever  quadratic 
phase  distortion  (Bl)  and/or  noise  was  present.  The  other 
estimators  exhibited  no  such  behavior  at  A  =  .l. 


Range  of  Convergence  Factors 


The  convergence  factors  control  the  rate  of  adaptation  of 
the  estimators.  The  weight  was  considered  to  have  converged  when 
the  deviation  is  less  than  .01%  from  its  final  rms  value.  First, 
various  of  convergence  factors  were  tried  on  the  estimators  with 
the  channel  having  no-distortion  and  no-noise  on  the  input 
symbols.  As  shown  in  Tables  I  -  III,  the  Feedforward  Estimator 
exhibits  a  range  of  convergence  factors  up  to  and  including  =.6 
for  the  three  weight  case  (G=3),  up  to  and  including  A  =.2  for 
the  seven  weight  case  (G=7)  and  A  =  .l  for  tne  ten  weight  (G=10) 
case  indicating  a  limitation  of  the  convergence  factor  based  on 
the  number  of  weights  in  the  estimator.  The  Feedback  Estimator 
will  converge  with  up  to  and  including  A  1=1.0  regardless 
of  the  number  of  weights  (see  Table  IV  -  VI).  The  Lattice 
Estimator  demonstrated  a  maximum  set  of  convergence  factors  of  A 
1  =  .01  and  A2=.l  independent  of  the  number  of  weights  (see  Tables 
VII  -  IX) .  No  lower  bound  was  found  as  all  estimators  exhibited 
similar  convergences  for  convergence  factors  of  .001  and  below. 


Response  to  Errors 


To  simulate  the  effects  of  errors  made  by  the  detector  or 
the  channel,  single  and  multiple  data  errors  were  fed  to  each  of 
the  estimators.  The  results  are  shown  in  Table  X.  For  single 
data  point  errors,  all  three  Estimators  show  similar  recovery 
times  when  conpared  at  identical  channel  conditions.  The  only 
exception  is  at  the  A=.i  Al=  .01,  A2=.l)  case  for  no-noise, 
no-distortion  where  the  Lattice  Estimator  recovered  significantly 
more  quickly  than  the  Feedback  Estimator  which  in  turn  recovered 
more  quickly  than  the  Feedforward  Estimator  (see  Figures  47-59 
and  55-57). 

When  multiple  consecutive  errors  were  introduced, such  as 
with  burst  noise,  both  the  Lattice  and  Feedback  Estimators  were 
almost  20  samples  faster  to  reconverge  than  the  Feedforward 
Estimator  which  required  80  samples  at  A  =  .l.  At  the  other 
selected  weighting  factors,  however,  performance  among  the  three 
was  comparable  (See  Table  X  and  Figures  50-54  and  58-60). 


Response  to  Changing  Channel  Characteristics 

The  final  characteristic  to  be  examined  was  the  response  of 
the  estimators  to  a  change  in  channel  characteristics  (See 
Figures  61-63).  The  channel  switched  from  no-noise, 
no-distortion  condition  to  one  of  maximum  amplitude  and  phase 
distortion  and  noise.  None  of  the  estimators  worked  well  with  a 
weighting  factor  of  A=.l  (Al  =  .01,  A2=.l).  At  other  weighting 
factors  the  estimators  all  adapted  at  approximately  the  same  rate 
with  no  significant  adaptation  time. 
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4.  Conclusions  and  Recommendations 

All  three  types  of  estimators  have  similar  characteristics 
as  the  convergence  factors  fall  below  .031  .  The  deviation  from 
distortion  and  noise  becomes  smaller  due  to  less  emphasis  on  what 
any  single  value  is  but  instead  more  on  the  general  trend.  It  is 
only  at  convergence  factors  of  .01  and  higher  that  any  decision 

can  be  made  as  to  the  desireability  of  one  estimator  over  the 
others  made  by  its  demonstrated  performance. 

At  convergence  factors  of  .31  and  higher,  the  clear  choice 
of  the  best  estimator  is  the  Feedback  Estimator.  Not  only  does 
it  have  the  largest  range  of  convergence  factors  (up  to  A=1.3) 
but  it  is  not  effected  by  the  numoer  of  weights  it  has  as  was  the 
case  for  the  Lattice  and  Feedforward  Estimators  under  certain 
conditions.  In  addition,  the  Feedback  Estimator  converged  more 
quickly  at  a  lower  convergence  factor  than  did  the  others. 

The  Feedback  Estimator  demonstrated  a  single  bit  error 
recovery  capability  that  was  superior  to  the  Feedforward 
Estimator  under  the  test  conditions  and  to  the  Lattice  Estimator 
in  two  out  of  three  test  cases.  Against  multiple  errors,  it  was 
again  superior  to  the  Feedforward  Estimator  and  about  equal  to 
the  Lattice  Estimator  in  performance. 

A  final  reason  for  choosing  the  Feedback  Estimator,  even  if 
all  performance  had  been  the  same,  would  have  been  the  simplicity 
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of  iiqplementation  as  opposed  to  the  two  other  estimators.  The 
Feedback  Estimator  requires  only  about  one  half  as  many 
multiplications  as  the  next  sinplest. 

Before  iirplementing  any  of  these  estimators  in  conditions 
that  require  convergence  factors  of  greater  than  .001  ,  the 
performance  of  the  estimator  would  be  greatly  improved  if  there 
were  an  adaptive  noise  canceller  used  as  a  pre-filter.  This 
would  decrease  the  deviation  due  to  the  noise  by  a  significant 
factor  allowing  the  channel  estimator  free  to  deal  with  only  the 
amplitude  and  phase  distortion. 
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Appendix  A 


Sample  Calculations  for  the  Feedforward  Adaptive  Estimator 

A  simple  case  was  chosen  to  illustrate  the  function  of  the 
Feedforward  Estimator  algorithm  and  to  serve  as  a  verification 
of  the  correct  operation  of  the  program.  To  simplify 

claculations,  a  three  weight  implmentation  was  chosen  as  is  shown 
in  Figure  9.  The  output  of  the  detector  X'k  was  assumed  to 
consist  of  the  following  sequence: 

X'k  =  C  1  -1  1  -1  1  .  .  .]  ( A. 1 ) 

Furthermore,  for  these  calculations,  only  the  no-noise  and 
no-distortion  case  will  be  considered  so  that  X'k  =  Y'k*  A 
convergence  factor,  &  ,  was  chosen  to  be  0.5  .  Utilizing 
Equation  (2.6),  where 

H\+i  ‘  H'k +  Aex  x'k-j  (2-6) 

the  tap  gain  coefficients  can  be  calculated. 
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For  the  first  inputs 


For  the  second  input: 


m 


m 


m 

x '  2  *  -1  x'l  =  1  x‘0  =  0 

(A. 9) 

§ 

| 

y  2  1,1^X  2^  +  ^h'l,2^X'l^  +  ^h  2,2^X  0^ 

(A.  10) 

M 

=  ( . 5 ) ( -1 )  +  (0)(1)  +  (0)(0) 

KSS 

=  -.5 

nt 


M 

I 

J 


$ 

11s? 


I 


y2  =  -i 


®2  y2  ~  y '  2 
=  -1  -  (-.5) 

=  -.5 


h'l  1  +  Ae2  x’2 
=  (.5)  +  ( . 5) (-. 5) (-1) 
=  .75 

=  h’1>2  +  Ae2  x'x 

=  (0)  +  ( . 5) (-. 5) (1 ) 

=  -.25 


h2,3  h'l,3  +  ^e2  X0 

=  (0)  +  (.5)  (-.5X0) 


( A. 11 ) 


( A. 12 ) 


(A. 13) 


(A. 14) 


( A. 15 ) 


After  the  second  input,  the  error  went  to  zero  during  the 
next  iteration  of  updating  the  estimated  tap  gain  coefficients 
and  stayed  there  as  long  as  the  pattern  of  alternating  1 1 s  and 
-l's  continued.  This  turned  out  not  to  be  the  general  case  as  a 
random  pattern  of  1 ' s  and  -l's  do  not  converge  to  the  tap  gains 
as  shown  but  rather  to  gains  of  h^  ^  =  1  ,  j  =  0  (  and  h^  ^  = 
0.  It  does  however  illustrate  the  typical  calculations  uaiticu 
on  by  this  algorithm. 
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Sample  Calculations  for  the  Feedback  Estimator 


The  sinple  case  of  three  taps  was  selected  to  illustrate  the 
workings  of  the  Feedback  Estimator  algorithm  as  shown  in  Figure 
10.  A  no-noise,  no-distortion  condition  was  placed  on  the 
channel  to  sinplify  calculations.  The  convergence  factor,  &  , 
was  chosen  to  be  .5  and  an  input  and  output  stream  to/from  the 

estimator  was  assumed  to  be: 


Yk  =  C  1  -1  -1  -1  1  1  -1  1] 


( A. 23 ) 


Shifting  in  the  first  three  inputs  gives: 


yl  1  y2 


=  -1 


(A. 24) 


x 1 1  =  1  x '  2  =  -1  x 1  3  =  -1 


( A. 25 ) 


V. 


(all  previous  values  of  h' 


are  zero  to 


Calculating  h’ 
start ) : 


v 


1,1 


"  *1  /  x'l 

=  1/1 


=  1 


0,j 


h' 


1,1 


=  ^vi,i  +  d-A)  v 

=  ( . 5) ( 1 )  +  (1-.5)  (0) 


=  .5 


The  values  are  updated  as  shown  in  Figure  and 
shifted  to  the  right.  No  new  data  is  input  to  the 
estimator  at  this  time,  however. 

*1  *  *2  '  (x'2)(h'l.l) 

-  -1  -  (-1H.5) 

=  -.5 

y2  =  y3  -  ( X1 3) (b* 1 #1 ) 

=  -1  -  (-1 )  ( .  5) 


(A. 26) 


(A. 27 ) 


the  result 
front  of  the 

(A. 28) 


(A. 29) 


1 


& 


f 


L 


Repeating  the  above  process  for  the  other  two  tap  gains 


V1 ,2  *  yl  '  x'l 


=  -.5  /  1 


=  -.5 


h  1,2  ^Vl,2  +  h0,2 

=  ( . 5) (-. 5)  +(l-. 5) (0) 

=  -.25 

Yl  =  y2  -  (x'2)(h'1(2) 

=  -.5  -  (-1 ) (-.25) 

=  -.75 

vi,3  =  *i  '  X'l 
=  -.75  /  1 

=  -.75 

h’l,3  =  ^Vl,3  +  (1“A>  V0,3 
=  ( .5) (—.75)  +  (1-. 5) (0) 

=  -.375 


(A. 30) 


( A. 31 ) 


(A. 32) 


(A. 33 ) 


(A. 34) 


Therefore  for  the  first  iteration  the  tap  gains  are: 

H’x  =  [.5,  -.25,  -.375  ]  (A.35) 

During  the  next  and  following  iterations,  a  new  point  is 
read  and  set  equal  to  yk+2  a11*3  the  preceding  two  bits  become 
y'k+1  and  y'k+2  respectively  so  that 

y2  =  -i  y3  =  -I  y4  =  -1  (a.  36) 

and 

x-2  =  -1  x 1 3  =  -1  x 1 4  =  -1  ( A.  37 ) 

Repeating  the  above  calculations  for  the  three  tap  gains: 

V2,l  =  y2  ^  X  2  ( A. 38 ) 

=  (-1)  /  (-1) 

=  1 


h2  1  -  Av2(1  -  (1-A)  h2^  (A.  39) 

=  {.5)(1)  -  (1-. 5) ( . 5) 

=  .75 
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y2  =  y3  -  ( x ' 3 )  (A. 40) 

=  (-D  -  (“1 )  ( •  75) 

=  -.25 

y3  =  y4  "  {xV  h2,l  ( A. 41 ) 

=  (-1)  -  (-1 ) ( .75) 

*  -.25 


v 


2,2 


=  y2  /  x*2 

=  (-.25)  /  (-1) 


(A. 42)  i 

(| 


=  .25 


h‘2/2  =  ^v2,2  +  (1~^)  hl,2  ( A. 43 ) 

=  ( . 5) ( . 25)  +  (1-.5) (-.25) 

=  3 


y2  y3  ~  ^ x ' 3^  h2,2  (A. 44) 

=  -.25  -  (-1 ) (0) 

=  -.25 
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=  (-.25)  /  (-1) 


=  .25 


h’2,3  =  Av2,2  +  {1_A)  hl,3 

=  ( . 5) ( .25)  +  (1-. 5) (-. 375) 


=  .0625 


Therefore,  for  the  second  iteration  the  tap  gains  are 


H'2  =  [.75,  0,  -.0625  ] 


The  calculations  can  be  continued  until  the  tap  gains  become 


H'k  =  [1,  0,  0  ] 


which  was  experimentally  verified. 
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le  Calculations  for  the  Lattice  Estimator 


The  sinple  case  of  three  tap  gains  and  a  two  stage  lattice 
filter  was  chosen  to  illustrate  the  algorithm  used  as  a  lattice 
estimator  as  shown  in  Figure  7.  The  no-noise,  no-distortion  case 
was  chosen  to  simplify  calculations.  Both  and  A2  were 
chosen  to  be  0.1  .  The  input  and  output  data  stream  was  assumed 
to  be: 


Yk  =  C  1  -1  -1  -1  1  1  -1  1] 


(A. 49) 


All  weights  (k's  and  h's)  are  assumed  to  be  zero  at  the  start  as 
are  any  previous  outputs  (x's). 

For  the  first  input  to  the  estimator: 


x* 


1 


=  X 


1,1 


(A. 53) 


Xl,2  Xl,l  +  k3,l  X>0,1 

=  1  +  (0)(0) 


(A. 51 ) 


=  1 


Xl,3  Xl,2  +  *0,2  X ' 0 , 2 


=  1  +  (3) (0) 

=  1 
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(A. 52) 


Updating  the  transversal  filter  portion  for  the  first  iteration 


yl  h0,l  xl,l  +  h0,2  x'l,2  +  h*0,3  x'l,3  (A*59) 

=  (0)  (1)  +  (0)  (0)  +  (0)  (0) 

=  (0) 


ei  -  yi  - y 
=  1-0 


h'l,l  “  h’0,l  +  ^2  ®1  X'l,l 

=  (0)  +  (.1)  (1)  (1) 


h’l,2  h  0,2  +  ^2  ®1  X  l,2 

=  (0)  +  ( .1 ) (1 ) CO) 


h'l,3  =  h  0,3  +  ^2  el  X '  1 , 3 

=  (0)  +  ( .1 ) (1 ) (0) 


(A. 60) 


(A. 61 ) 


(A. 62) 


(A. 63) 


Therefore  for  the  first  iteration  the  various  gains  are 


Kj_  =  [  0,0  ] 

and 


(C.64) 


Hx  =  C  .1,  0,  0  ] 


(C.65) 


When  the  next  input  to  the  estimator  is  read  in  the  process 
begins  again  with  the  following  results: 


X  2  x2,l  x2,l  “  _1 

X2,2  =  X2 ,1  +  kl,l  x‘l,l 

=  -1  +  (0) (0) 

=  -1 


X2,3  X2,2  +  kl,2  xl,2 

=  -1  +  (0)(0) 

=  -1 


X  2,2  kl,l  X2,l  +  X'l,l 
»  (0) (-1)  +  (1) 

=  1 


(C. 66) 


(C. 67 ) 


(C.68) 


(C. 69) 


e 


f  2 


=  x 


2,3 


=  -1 


(C. 70) 
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(A.  76 


i  € 


For  the  second  iteration  the  various  gains  are 


k2  =  [  .1,  0  ] 


and 


H2  »  [  .19,  -.09,  0  ] 


For  the  third  input  the  results  are: 


X  3  X3,l  *  X'  3,1  -1 


X3,2  X3 , 1  +  k2,l  X' 2,1 


=  (-1)  +  ( .1 ) (-1 ) 

=  -1.1 


3,3 


X3,2  +  k2,2  X ' 2,2 


(-1.1)  +  (0)(-l) 

(-1.1) 
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(A. 79) 


(A. 80) 


(A. 81 ) 


( A.82 ) 


(A. 83) 


3,2  ~  k2,l  X3,l  +  x*  2,1 

=  (.1)(-1)  +  (-1) 

=  -1.1 


(A. 84) 


3,3  =  k2,2  X3,2  +  x' 2,2 

=  (0) (-1.1)  +  (1) 

=  1 


(A. 85) 


ef 3  X3, 3 

=  -1.1 


(A. 86) 


%3  X<  3, 3 
■  1 


(A. 87 ) 


:3,1  k2 ,1  “  ^1  X3,2  X'  2,1 

=  (.1)  -  (.1)(-1.1)(-1) 

=  -.01 


(A. 88) 


l3,2  k2,2  ~  ^1  X3, 3  X '  2 , 2 

=  (0)  -  (.1)(-1.1)(1) 

=  .11 


(A. 89) 


Updating  the  transversal  filter  portion  for  this  iterations: 


~  h<  2,1  X*  3,1  +  h'2,2  X*  3,2  +  h'2,3  X>3,3 
=  (.19)  (-1)  +  (-.09) (-1 .1 )  +  (0)(1.0) 


(A. 90) 


=  -.091 


e3  =  y3  -  y  3 


=  (-1)  -  (-.091) 
=  (-.909) 


(A.91) 


h3,l  h’2,l  +  ^2  e3  X '  3, 1 

=  (.19)  +  (•!)(-. 909 ) ( -1 . 1 ) 


(A. 92 ) 


=  .231 


h  3,2  “  h<2,2  +  ^2  e3  X*  3,2 

=  (-.09)  +  (.1)  (-.939)  (-1.1) 


(A. 93) 


=  .01 


h  2,3  +  ^2  e3  X  3,3 
=  (0)  +  ( .1 ) (-.909) (1 ) 


(A. 94) 


=  -.091 


After  this  iteration  then  the  various  gains  are 

K3  =  [  -.01,  .11  ] 


(A. 95) 


H3  =  [  .281,  .010,  -.091  ] 


(A. 96) 


Appendix  B 

Derivation  of  the  Lattice  Filter 

Of  the  various  forms  of  filters,  the  direct,  cascade  and 
parallel  forms  are  the  best  known.  There  are  occassions  however 
when  a  fourth  form,  the  lattice,  can  be  more  effectively  utilized 
such  as  the  case  of  adaptive  filtering. 

The  transfer  function  of  a  system  can  be  rewritten  in  the 
Z-transform  form  of  a  filter.  This  is  expressed  as 


H(z)  =  Y(z)  (B.l) 

xtzT 

- 

i+bTz) 

=  a0  +  aiz_1  +  •••  +  aLz~1 


1  +b^z^+...  +  b^z 


or  alternately  as 


H(z)  = 


A.  (z) 

*L0  *  ^l2"1  +  +aLLZ  ' 
bL0  +  ^l2"1  +  •“  +  hLLz 


(B.2) 


where  bT a  is  always  equal  to  one  (9) 


Starting  with  Eq  (D.2)  the  following  algorithm  can  be 


defined.  For  m  =  L,  L-l ,  ...»  1  : 


z  C  (z) 
m 


m-1 

v. 


Vi'2' 


z'1  B  (z"1) 
m 


=  b 


11 


=  a 


11 

BJs)  -  K 


nr 


.  z  C  ( z) 
m— 1  m 


1  -  k‘ 


m-1 


Am_i{z)  =  A(z)  -  vm  z  Cm(z) 


(B.3) 

(B.4) 

(B.5) 

(B.6) 


(B.7) 


where  k^^  and  vm  are  the  coefficients  used  in  the  lattice.  Using 
Eq  (D.7)  and  substituting  it  into  itself,  A^z)  can  be  written 
as: 


Vz)  =  \-l(z)  +  VL  z  CL(z) 

=  A^U)  +  vL-1  z  CL_1  ( z)  + 


(B.8) 


VL  Z  CL(Z) 


=  Agtz)  +  v1  z  C^z)  + 
=  a0  +  vx  z  C^z)  + 
=  v0  +  v1  z  CL(z)  + 


z  C  (z) 


+  VL  Z  CL(Z) 
t  VL  z  ^(z) 

+  VL  z  C^z) 


( B.  9 ) 


Substituting  for  A^(z)  in  Eq  (D.2)  gives  the  transfer  function 

L 


H( z)  =  v — v  v  z  C(z) 
\  mm 


( B. 10 ) 


\(z) 


so  that 


Y(z) 

“'pv m  2  Cm(z)  x(z) 

(B.ll) 

l—j  B,(z) 

m=0 

Using  the 

results 

developed  by  Itakura 

and  Saito  (10),  the 

following 

equations 

for  B  (z)  and  z  C  (z)  can  be  developed: 
mm 

B_(  z) 
in 

“  Bm-l(z)  +  Vl  Vl(z) 

( B. 12 ) 

and 

zC  (z) 
m 

■  Vl  Bm-l(z)  +  Z_1  C  z 

Cm-l(z)  3  (B.13) 

Using  Eqs  (D.ll),  (D.12),  and  (D.13),  the  lattice  element  shown 
in  Figure  12  can  be  created.  The  elements  may  be  combined  to 
form  larger  lattice  structures  as  shown  in  Figure  13. 
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Multi-Stage  Lattice 


endix  C 


Results  of  Estimator  Tests 


This  appendix  contains  selected  outputs  from  the  estimator  tests 
All  graphs  are  of  Weight  1 ,  h^  . 
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Figure  16.  Feedforward  Estimator,  Three  Weights,  A*. 001 
Bl<4),  B2*<3,  G1^3,  Noised 
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Figure  17.  Feedforward  Estimator,  Three  Weights 
Bl-1,  B2-1,  Gl-1,  Noise-0.2 


Figure  18.  Feedforward  Estimator ,  Seven  Weight*  A“.l 
Bl^,  B2^,  Gl-«,  Noiae-0 
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Figure  28. 


Feedback  Estimator,  Three  Weights  A«.l 
B1=0,  B2=€l,  Gl*^,  Noise=0 


A=.0i 


Figure  29.  Feedback  Estimator,  Three  Weights 
B1*0,  B2M3 ,  Gl*4,  Noised 
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Figure  34. 


Feedback  Estimator,  Seven  Weights 
Bl=l,  B2=l,  61=1,  Noise=0.2 
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Figure  38.  Lattice  Estimator ,  Three  Weights 
B1=0,  B2=0,  G1=0 ,  Noise=0 
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Figure  40.  Lattice  Estimator,  Three  Weight* 

Bl-1.  B2-1.  Gl-1.  Moiae-0.2  A*..#: 
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Lattice  Estimator,  Three  Weights 
Bl-1.  B2-1,  01-1.  Noiee-0.2 


A  -.001 
AJ-.001 


>v 


i  Koj  HI  i  (.Hi  ] 


*JJ  1t.ec  60.  CO  C'.JI  I'Jv.iO  i'X.i  !t..U. 

_M[{[ 

Figure  50.  Feedforward  Estimator,  Three  Weights,  A=.l 
Ten  Errors  at  100 
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Figure  53.  Feedback  Estimator,  Three  Weights,  A *.01 
Ten  Errors  at  100 
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Feedback  Katin*  tor  ,  Three  Weights,  L±  -  -W\ 
Ten  Error*  at  100 
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Figure  57.  Lattice  Estimator,  Three  Weights, 
One  Error  at  100 
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Figure  56.  Lattice  Estimator,  Three  Weights, 
Ten  Errors  at  100 
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Figure  59.  Lattice  Estimator,  Three  Weights, 
Tan  Errors  at  100 
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Figure  60.  Lattice  Estimator,  Three  Weights, 

Ten  Errors  at  100 
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Figure  61.  Feedforward  Estimator,  Three  Weights  A*.01 
Channel  Change  at  250 
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